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Self-Adaptive  Discovery  Mechanisms 
for  Optimal  Performance  in  Fault-Tolerant  Networks 


Survivable  Software  for  Harsh  Environments 


Innovations 


Read-and-react  decentralized  discovery 
mechanisms  that  observe  the  network  state, 
estimate  and  adjust  relevant  parameters, 
measure  effects,  and  adapt  as  necessary 

>  Emerging  industry  discovery  protocols  assume 
parameters  configured  and  tuned  by  hand  and 
network  topology  evolves  slowly.  Assumptions 
invalid  for  most  military  scenarios  (fast  response, 
high  mobility,  cyber  and  physical  attacks,  and 
jamming  of  communication  channels). 

Simulation  modeling  techniques  to  create 
and  measure  the  effects  of  continuous, 
controlled  changes  in  network  topologies 


Impact 


Schedule 


•  Influence  the  design  of  next-generation 
discovery  protocols  so  they  can  self- 
configure  tunable  parameters  and  can 
adjust  in  response  to  network  dynamics 

•  Influence  the  design  of  next-generation 
simulation  systems  to  provide  better 
support  for  simulating  controlled  and 
continuous  change  in  network  topologies 
and  for  collecting  related  measurements 


Start 

June  01 


Prototype  implementation 
Simulation  Models  of  selected  self-adaptation 

and  Benchmark  Results  algorithms  in  publicly 

for  UPnP  and  Jini  available  reference  software 

July  02  July  03 


Deliver 

packaged 

code 

April  04 


Jan  02 

Document 

candidate 

self-adaptation 

algorithms 


Jan  03 

Simulation  Results 
for  selected  self¬ 
adaptation  algorithms 


Jan  04 

Validation  results 
for  prototype 
reference 
implementations 
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Dynamic  Discovery  Protocois  in  Essence 

Dynamic  discovery  protocols  enable  network  elements  (including  software 
clients  and  services,  as  well  as  devices): 

(1 )  to  discover  each  other  without  prior  arrangement, 

(2)  to  express  opportunities  for  collaboration, 

(3)  to  compose  themselves  into  larger  collections  that  cooperate  to  meet 
an  application  need,  and 

(4)  to  detect  and  adapt  to  changes  in  network  topology. 


Seiected  First-Generation  Dynamic  Discovery  Protocois 
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Dynamic  Discovery  Protocois  Provide  Foundation 
for  Fault-Toierant  Distributed  Systems 

•  In  the  future,  all  software  systems  will  be  distributed  systems 
written  to  operate  over  a  network,  where  conditions  vary. 

•  Dynamic  discovery  protocols  provide  a  foundation  upon  which 
such  distributed  systems  will  be  constructed. 

•  Understanding  the  current  (first)  generation  of  discovery  protocols 
essentiai  to  enable  the  military  to  establish  requirements  and  to  help 
industry  to  improve  designs  for  the  second  and  subsequent 
generations. 

NIST  Investigating  Emerging  Commercial  Designs 

•  Modeling  and  anaiyzing  the  structure,  behavior,  performance  and 
logical  properties  of  selected  discovery  protocois 

(Jini,  UPnP,  and  SLP) 

•  Measuring  the  performance  properties  of  the  current  reference 
software  that  implements  seiected  discovery  protocols 

(Jini,  UPnP,  and  SLP) 
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Technical  Approach  to  Modeling  &  Analysis _ 

*  Model  Discovery  Protocol  specifications  using  Architecturai 
Description  Languages  (ADLs)  and  associated  tools 

*  Analyze  Discovery  Protocol  models  to  assess  consistency,  correctness, 
and  completeness  under  conditions  of  dynamic  change. 

*  Compare  and  contrast  our  models  with  regard  to  function,  structure, 
behavior,  performance,  complexity,  and  scalability  under  conditions  of 
dynamic  change. 


Technical  Approach  to  Measurement 

*  Design  technology-independent  benchmark  service  and  scenarios. 

*  Create  synthetic  workload  generation  tools  for  emulating  the 
behavior  of  moderate-scale  dynamic  ad  hoc  networking  environments. 

*  Develop  implementation-independent  performance  measurement 
methodologies  and  tools  for  service  discovery  protocols  (SDPs)  and 
required  supporting  protocols. 


EXANPLES  FOLLOW  ON  NEXf  THREE  SLIDES 
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Example  #1:  Define  Generic  Structural  Model  (UML) 

for  Service-Discovery  Domain 


Service 


SERVICE  MANAGER 

service  information  collection 

SERVICE  CACHE  MANAGER 

B^iscover  Network  Context() 

_ — - - 0..* 

Bdiscover  Network  Context() 

B<*^riot  shr»  Cache  Manager  Discovery() 

shr»  activate  Manager  Discovery() 

B«OPT»  Announce  Service  Processing() 

+service  info 

+infn  rarhp 

Bactiv ate  Announce  Processing() 

B«not  shr»  start  Renewal  Task() 

source  cacne 

Bstart  Matching  Task() 

BServ  ice  Manager() 

Bstart  Aging  Task() 

B^*^riot  shr»  start  Service  Parameter  Matching  Task() 

0..* 
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Provides  Foundation  for  Measurements  and  Comparisons 
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Example  #2:  Construct,  Exercise,  and  Analyze 
Executable  Model  from  Specifications  of  Discovery  Protocols 


Time 

Command 

Parameters 

5 

NodeFail 

SM4 

5 

LinkFail 

SCMl  SM4 

10 

GroupJoin 

SM4  GROUP  1 

10 

FindService 

SU8  5  1  2  S  XYZ  ALL 

50 

Adds  er  vice 

SM4  SCM3  T  ATT  API  GUI  20  30 

Scenario 


Topology 


Specification 


^  J  1*^  firtan  laiiliUi'fcii 

a 

<4 - 

1 

Multicast  Group 

-**3.3  DIRECTED  DISCOVERY  CLIENT  INTERFACE  ** 

s|csKs|csKsK!|c!K********************************************* 

-  This  is  used  by  all  JINI  entities  in  direeted 

-  diseovery  mode.  It  is  part  of  the  SCM  Diseovery 

-  Module.  Sends  Unieast  messages  to  SCMs  on  list  of 

-  SCMS  to  be  diseovered  until  all  SCMS  are  found. 

-  Reeeives  updates  from  SCM  DB  of  diseovered  SCMs  and 

-  removes  SCMs  aeeordingly 

-  NOTE:  Failure  and  reeovery  behavior  are  not 

-  yet  defined  and  need  reviw. 

TYPE  DireetedDiseoveryClient 

(SoureelD  :  IP  Address;  biSCMsToDiseover  :  SCMList;  StartOption  :  DD  Code; 
biRequestbiterval :  TimeUnit;  In  MaxNum  Tri  es  :  integer;  biPV  :  ProtoeolVersion) 

IS  INTERFACE 

SERVICE  DDC_SEND  DIR  :  DIRECTED  2  STEP  PROTOCOL; 

SERVICE  DISC_MODES  :  dual  SCM  DISCOVERY  MODES; 

SERVICE  DD  SCM  Update  :  DD  SCM  Update; 

SERVICE  SCM  Update  :  SCM  Update; 

SERVICE  DB  Update  :  dual  DB  Update; 

SERVICE  NODE  FAILURES  :  NODE  FAILURES;  -  events  for  failure  and  reeovery. 
ACTION 

IN  Send_Requests(), 

BeginDireetedDiseoveryO; 

BEHAVIOR 

aetion  animation  lam  (name:  string); 

MySoureelD  :  VAR  IP  Address; 

PV  :  VAR  ProtoeolVersion; 


Execute  with 
Rapide^^'^ 


Consistency 

Conditions 


For  AM  (SM,  SD,  SCM): 

(SM,  SD)  IsElementOf  SCM  registered-services  (CC1) 
impiies  SCM  IsEiementOf  SM  discovered-SCMs 
ForAii(SM,SD,  SCM): 

SCM  IsEiementOf  SM  discovered-SCMs  &  (CC2) 

(SD)  IsEiementOf  SM  managed-services 
impiies  (SM,  SD)  IsEiementOf  SCM  registered-services 
ForAii  (SM,  SD,  SCM): 

SCM  IsEiementOf  SM  discovered-SCMs  &  (CCS) 

(SM,  SD)  isEiementOf  SCM  registered-services  & 

NOT  (SCM  IsEiementOf  SM  persistent-iist) 
impiies  intersection  (SM  GroupsToJoin,  SCM  GroupsMemberOf) 
ForAii  (SM,  SD,  SCM,  SU,  NR): 

(SU,  NR)  isEiementOf  SCM  requested-notifications  &  (CC4) 

(SM,  SD)  isEiementOf  SCM  registered-services  & 

Matches((SM,  SD),  (SU,NR)) 

impiies  (SM,  SD)  isEiementOf  SU  matched-services 


Analyze 

POSETs 


Assess  Correctness, 
Performance,  & 
Complexity 
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Example  #3:  Construct  Synthetic  Workload 
Generation  and  Measurement  Tools 


Objective:  Emulate  large,  dynamic  environments  of  100’s  of  devices/services 
and  10’s  of  control  points  /  clients. 

•  Dynamic  devices  provided  the  benchmark  service. 

•  Scripted  control  points  execute  measurement  scenarios. 

•  SDP  Experimenters  Tooikits 

-  Drive  real  SDP  implementations 

-  Emulate  the  behavior  of  a  large  number  of 
dynamic  devices 

-  Emulate  the  behavior  of  control  points  and 
provide  scripted  behavior  for  testing 

-  Jini  &  UPnP  Initial  development  complete 

-  SunMS  Jini,  Intel  UPnP  on  Linux  platforms. 

-  Achieved  100’s  of  devices  and  10’s  of  control  points 


Measure  Latency  and  Overhead  In  Moderate-Scale 
Deployment  of  Discovery  Protocol  Implementations 
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Objective  for  Our  FTN  Project 

Research,  design,  evaluate,  and  implement  self-adaptive  algorithms 
to  improve  the  performance  of  service  discovery  protocols 
for  use  in  fault-tolerant  networks. 


Motivation 

•  Emerging  designs  for  military  fault-tolerant  systems  (e.g.,  OpenWings, 
OASIS,  CoABS)  rely  on  discovery-based  component  architectures  to  enable 
self-organizing  and  self-healing  behavior 

•  The  discovery  protocols  underlying  such  systems  include  mechanisms  that 
permit  network  elements  to  continue  to  function  as  the  topology  varies 

•  However,  many  performance  aspects  of  these  protocols  appear  sensitive  to 
parameter  settings  whose  optimum  values  depend  upon  network  topology 

•  While  such  parameters  may  be  manually  configured  and  tuned  in  relatively 
small,  static  environments,  their  management  in  larger  scale,  highly  dynamic 
environments  requires  decentralized  real-time  measurement  and  control 
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Sample  Problem  Based  on  Measurements 
of  Universal  Plug-and-Play 

UPnP  Discovery  Performance  in  a  64-Node  Network 


1/31/2002 


Value  of  Tunable  Jitter  Parameter  (in  miiiiseconds) 


11 


Nisr 

National  Institute  of  Standards  and  Technology 

Technology  Administration,  US,  Department  of  Commerce 


NtST  CENTENNIAL 


Selected  Control  Parameters  of  Interest 


•  Universal  Plug-and-Play 

■  announcement  interval 

■  response  jitter  time 

■  entry  expiration  time 

■  requested  and  granted  subscription  expiration  times 

■  maximum  response  time 

■  message  repeat  count  and  interval 

•  Jini™  Networking  Technology 

■  announcement  and  probe  intervals 

■  requested  and  granted  lease  expiration  times 

■  maximum  lookup  servers  to  discover 

■  maximum  matches  returned 


•  Service  Location  Protocol 

■  announcement  and  probe  intervals 

■  entry  lifetime 

■  minimum  refresh  interval 

■  maximum  response  time 

■  message  repeat  period  and  interval 
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•  Universal  Plug-and-Play 

■  dynamic  reassignment  of  multicast  group  membership 

■  response  of  device  to  changes  in  device  descriptions 

■  cache  filtering,  purging,  and  triggering  in  control  points 

■  query  behavior  in  control  points 

•  Jini™  Networking  Technology 

■  dynamic  reassignment  of  logical  group  membership 

■  dynamic  reassignment  of  multicast  group  membership 

■  injection  of  event  filters  into  services 

■  dynamic  management  of  lookup  services  in  response  to  load  variation 

•  Service  Location  Protocol 

■  dynamic  mode  switching  between  2-party  and  3-party  operation 

■  dynamic  management  of  cache  flushing  by  directory  service  agents 

■  dynamic  management  of  scopes 
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Research  Plan 

•  Model  and  analyze  existing  protocols  (UPnP,  Jini,  and  SLP) 

■  develop  simulation  models  for  each  protocol 

■  determine  appropriate  techniques  to  model  link  and  node  failures 

■  establish  performance  benchmarks  based  on  default  or  recommended 
parameter  values  and  on  required  or  most  likely  implementation  of  behaviors 

•  Investigate  distributed  adaptation  algorithms  to  control  parameter  values 
(and  also  consider  selected  adaptive  behaviors) 

■  devise  several  algorithms  to  adjust  similar  control  parameters  in  each  protocol 

■  simulate  performance  of  each  algorithm  against  benchmark  performance 

■  select  most  promising  algorithms  for  further  development 

•  Implement  and  validate  selected  algorithms  in  publicly  available  reference 
software 

■  modify  available  implementation  of  UPnP,  Jini,  or  SLP 

■  deploy  in  service-discovery  test  bed  (now  under  development  at  NIST) 

■  validate  simulated  results  with  live  experiments 

■  Expected  results:  published  papers,  simulation  models,  reference  software, 

experiment  data,  influence  on  design  of  future  dynamic  discovery 
protocols 
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Conclusions 

•  Emerging  designs  for  military  fault-tolerant  systems  rely  on  discovery-based 
component  architectures  to  enable  self-organizing  and  self-healing  behavior 

•  Emerging  industry  discovery  protocols  assume  parameters  configured  and  tuned  by 
hand  and  network  topology  evolves  slowly 

■  Such  assumptions  are  invalid  for  most  military  scenarios,  which  require  fast 
response,  exhibit  high  mobility,  suffer  cyber  and  physical  attacks,  as  well  as 
jamming  of  communication  channels 

•  We  propose  a  solution:  read-and-react  decentralized  discovery  mechanisms  that 
observe  the  network  state,  estimate  and  adjust  relevant  parameters,  measure  effects, 
and  adapt  as  necessary 

■  How  will  such  mechanisms  perform  under  military  and  commercial  conditions? 

■  What  will  be  the  cost  of  such  mechanisms  in  complexity  and  overhead? 

■  Can  existing  commercial  protocols  accommodate  such  mechanisms? 

•  Success  in  this  research  would  enable  the  military  to  leverage  future  generations  of 
dynamic  discovery  protocols  as  a  foundation  for  survivable  software  architectures 
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